Multiple Pixel Scanning LIDAR

ABSTRACT

Methods and systems for performing three-dimensional (3-D) LIDAR measurements with multiple illumination beams scanned over a 3-D environment are described herein. In one aspect, illumination light from each LIDAR measurement channel is emitted to the surrounding environment in a different direction by a beam scanning device. The beam scanning device also directs each amount of return measurement light onto a corresponding photodetector. In some embodiments, a beam scanning device includes a scanning mirror rotated in an oscillatory manner about an axis of rotation by an actuator in accordance with command signals generated by a master controller. In some embodiments, the light source and photodetector associated with each LIDAR measurement channel are moved in two dimensions relative to beam shaping optics employed to collimate light emitted from the light source. The relative motion causes the illumination beams to sweep over a range of the 3-D environment under measurement.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application for patent is a continuation of U.S. patentapplication Ser. No. 15/610,975, entitled “Multiple Pixel ScanningLIDAR,” filed Jun. 1, 2017, which claims priority under 35 U.S.C. § 119from U.S. provisional patent application Ser. No. 62/344,259, entitled“Multiple Pixel Scanning LIDAR,” filed Jun. 1, 2016, the disclosures ofwhich are incorporated herein by reference in their entireties.

TECHNICAL FIELD

The described embodiments relate to LIDAR based three-dimensional (3-D)point cloud measuring systems.

BACKGROUND INFORMATION

LIDAR systems employ pulses of light to measure distance to an objectbased on the time of flight (TOF) of each pulse of light. A pulse oflight emitted from a light source of a LIDAR system interacts with adistal object. A portion of the light reflects from the object andreturns to a detector of the LIDAR system. Based on the time elapsedbetween emission of the pulse of light and detection of the returnedpulse of light, a distance is estimated. In some examples, pulses oflight are generated by a laser emitter. The light pulses are focusedthrough a lens or lens assembly. The time it takes for a pulse of laserlight to return to a detector mounted near the emitter is measured. Adistance is derived from the time measurement with high accuracy.

Some LIDAR systems employ a single laser emitter/detector combinationcombined with a rotating mirror to effectively scan across a plane.Distance measurements performed by such a system are effectivelytwo-dimensional (2-D) (i.e., planar), and the captured distance pointsare rendered as a 2-D (i.e. single plane) point cloud. In some examples,rotating mirrors are rotated at very fast speeds (e.g., thousands ofrevolutions per minute).

In many operational scenarios, a 3-D point cloud is required. A numberof schemes have been employed to interrogate the surrounding environmentin three dimensions. In some examples, a 2-D instrument is actuated upand down and/or back and forth, often on a gimbal. This is commonlyknown within the art as “winking” or “nodding” the sensor. Thus, asingle beam LIDAR unit can be employed to capture an entire 3-D array ofdistance points, albeit one point at a time. In a related example, aprism is employed to “divide” the laser pulse into multiple layers, eachhaving a slightly different vertical angle. This simulates the noddingeffect described above, but without actuation of the sensor itself.

In all the above examples, the light path of a single laseremitter/detector combination is somehow altered to achieve a broaderfield of view than a single sensor. The number of pixels such devicescan generate per unit time is inherently limited due limitations on thepulse repetition rate of a single laser. Any alteration of the beampath, whether it is by mirror, prism, or actuation of the device thatachieves a larger coverage area comes at a cost of decreased point clouddensity.

As noted above, 3-D point cloud systems exist in several configurations.However, in many applications it is necessary to see over a broad fieldof view. For example, in an autonomous vehicle application, the verticalfield of view should extend down as close as possible to see the groundin front of the vehicle. In addition, the vertical field of view shouldextend above the horizon, in the event the car enters a dip in the road.In addition, it is necessary to have a minimum of delay between theactions happening in the real world and the imaging of those actions. Insome examples, it is desirable to provide a complete image update atleast five times per second. To address these requirements, a 3-D LIDARsystem has been developed that includes an array of multiple laseremitters and detectors. This system is described in U.S. Pat. No.7,969,558 issued on Jun. 28, 2011, the subject matter of which isincorporated herein by reference in its entirety.

In many applications, a sequence of pulses is emitted. The direction ofeach pulse is sequentially varied in rapid succession. In theseexamples, a distance measurement associated with each individual pulsecan be considered a pixel, and a collection of pixels emitted andcaptured in rapid succession (i.e., “point cloud”) can be rendered as animage or analyzed for other reasons (e.g., detecting obstacles). In someexamples, viewing software is employed to render the resulting pointclouds as images that appear 3-D to a user. Different schemes can beused to depict the distance measurements as 3-D images that appear as ifthey were captured by a live action camera.

Improvements in the opto-mechanical design of LIDAR systems are desired,while maintaining high levels of imaging resolution and range.

SUMMARY

Methods and systems for performing 3-D LIDAR measurements with multipleillumination beams scanned over a 3-D environment are described herein.

In one aspect, illumination light is directed toward a particularlocation in the surrounding environment by one or more beam shapingoptical elements and a beam scanning device. In a further aspect, thereturn measurement light is directed and focused onto a photodetector bythe beam scanning device and the one or more beam shaping opticalelements. The beam scanning device is employed in the optical pathbetween the beam shaping optics and the environment under measurement.The beam scanning device effectively expands the field of view andincreases the sampling density within the field of view of the 3-D LIDARsystem.

In some embodiments, a 3-D LIDAR system includes an array of lightsources aligned in a plane. Each light source is associated with adifferent LIDAR measurement channel. The 3-D LIDAR system also includesa beam scanning device including a scanning mirror rotated in anoscillatory manner about an axis of rotation by an actuator inaccordance with command signals generated by a master controller. Eachbeam reflects from the surface of the scanning mirror in a differentdirection. In this manner, the objects in the environment areinterrogated by different beams of illumination light at differentlocations. The scanning mirror causes the illumination beams to sweepover a range of the 3-D environment under measurement.

In some other embodiments, the array of light sources is 2-D, and the2-D field of measurement beams is swept over a range of the 3-Denvironment under measurement.

In another aspect, the light source and detector of each LIDARmeasurement channel are moved in two dimensions relative to beam shapingoptics employed to collimate light emitted from the light source. The2-D motion is aligned with the optical plane of the beam shaping opticand effectively expands the field of view and increases the samplingdensity within the field of view of the 3-D LIDAR system.

The foregoing is a summary and thus contains, by necessity,simplifications, generalizations and omissions of detail; consequently,those skilled in the art will appreciate that the summary isillustrative only and is not limiting in any way. Other aspects,inventive features, and advantages of the devices and/or processesdescribed herein will become apparent in the non-limiting detaileddescription set forth herein.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a simplified diagram illustrative of one embodiment of a 3-DLIDAR system 100 in at least one novel aspect.

FIG. 2 depicts an illustration of the timing of emission of a pulsedmeasurement beam and capture of the returning measurement pulse.

FIG. 3 depicts a view of light emission/collection engine 112 of 3-DLIDAR system 100.

FIG. 4 depicts a view of collection optics 116 of 3-D LIDAR system 100in greater detail.

FIG. 5 depicts an embodiment 200 of a 3-D LIDAR system employing a beamscanning device.

FIG. 6 depicts an embodiment 300 of a 3-D LIDAR system employing a beamscanning device.

FIG. 7 depicts an embodiment 400 of a 3-D LIDAR system employing a beamscanning device.

FIG. 8 depicts an embodiment 210 of a 3-D LIDAR system employing a 2-Darray of light sources 211.

FIG. 9 depicts an integrated LIDAR measurement device 120 in oneembodiment.

FIG. 10 depicts a schematic view of an integrated LIDAR measurementdevice 130.

FIG. 11 depicts a flowchart illustrative of a method 500 of performingmultiple LIDAR measurements based on scanning measurement beams in atleast one novel aspect.

DETAILED DESCRIPTION

Reference will now be made in detail to background examples and someembodiments of the invention, examples of which are illustrated in theaccompanying drawings.

FIG. 1 depicts an LIDAR measurement system 100 in one embodiment. LIDARmeasurement system 100 includes a master controller 190 and one or moreintegrated LIDAR measurement devices 130. An integrated LIDARmeasurement device 130 includes a return signal receiver integratedcircuit (IC), an illumination driver integrated circuit (IC) 152, anillumination source 160, a photodetector 170, and a trans-impedanceamplifier (TIA) 180. Each of these elements is mounted to a commonsubstrate 135 (e.g., printed circuit board) that provides mechanicalsupport and electrical connectivity among the elements.

Illumination source 160 emits a measurement pulse of illumination light162 in response to a pulse of electrical current 153. In someembodiments, the illumination source 160 is laser based (e.g., laserdiode). In some embodiments, the illumination source is based on one ormore light emitting diodes. In general, any suitable pulsed illuminationsource may be contemplated. Illumination light 162 exits LIDARmeasurement device 100 and reflects from an object in the surrounding3-D environment under measurement. A portion of the reflected light iscollected as return measurement light 171 associated with themeasurement pulse 162. As depicted in FIG. 1, illumination light 162emitted from integrated LIDAR measurement device 130 and correspondingreturn measurement light 171 directed toward integrated LIDARmeasurement device share a common optical path.

In one aspect, the illumination light 162 is focused and projectedtoward a particular location in the surrounding environment by one ormore beam shaping optical elements 163 and a beam scanning device 164 ofLIDAR measurement system 100. In a further aspect, the returnmeasurement light 171 is directed and focused onto photodetector 170 bybeam scanning device 164 and the one or more beam shaping opticalelements 163 of LIDAR measurement system 100. The beam scanning deviceis employed in the optical path between the beam shaping optics and theenvironment under measurement. The beam scanning device effectivelyexpands the field of view and increases the sampling density within thefield of view of the 3-D LIDAR system.

In the embodiment depicted in FIG. 1, beam scanning device 164 is amoveable mirror element that is rotated about an axis of rotation 167 byrotary actuator 165. Command signals 166 generated by master controller190 are communicated from master controller 190 to rotary actuator 165.In response, rotary actuator 165 scans moveable mirror element 164 inaccordance with a desired motion profile.

Integrated LIDAR measurement device 130 includes a photodetector 170having an active sensor area 174. As depicted in FIG. 1, illuminationsource 160 is located outside the field of view of the active area 174of the photodetector. As depicted in FIG. 1, an overmold lens 172 ismounted over the photodetector 170. The overmold lens 172 includes aconical cavity that corresponds with the ray acceptance cone of returnlight 171. Illumination light 162 from illumination source 160 isinjected into the detector reception cone by a fiber waveguide. Anoptical coupler optically couples illumination source 160 with the fiberwaveguide. At the end of the fiber waveguide, a mirror element 161 isoriented at a 45 degree angle with respect to the waveguide to injectthe illumination light 162 into the cone of return light 171. In oneembodiment, the end faces of fiber waveguide are cut at a 45 degreeangle and the end faces are coated with a highly reflective dielectriccoating to provide a mirror surface. In some embodiments, the waveguideincludes a rectangular shaped glass core and a polymer cladding of lowerindex of refraction. In some embodiments, the entire optical assembly isencapsulated with a material having an index of refraction that closelymatches the index of refraction of the polymer cladding. In this manner,the waveguide injects the illumination light 162 into the acceptancecone of return light 171 with minimal occlusion.

The placement of the waveguide within the acceptance cone of the returnlight 171 projected onto the active sensing area 174 of detector 170 isselected to ensure that the illumination spot and the detector field ofview have maximum overlap in the far field.

As depicted in FIG. 1, return light 171 reflected from the surroundingenvironment is detected by photodetector 170. In some embodiments,photodetector 170 is an avalanche photodiode. Photodetector 170generates an output signal 173 that is amplified by an analogtrans-impedance amplifier (TIA) 180. However, in general, theamplification of output signal 173 may include multiple, amplifierstages. In this sense, an analog trans-impedance amplifier is providedby way of non-limiting example, as many other analog signalamplification schemes may be contemplated within the scope of thispatent document. Although TIA 180 is depicted in FIG. 1 as a discretedevice separate from the receiver IC 150, in general, TIA 180 may beintegrated with receiver IC 150. In some embodiments, it is preferableto integrate TIA 180 with receiver IC 150 to save space and reducesignal contamination.

The amplified signal 181 is communicated to return signal receiver IC150. Receiver IC 150 includes timing circuitry and a time-to-digitalconverter that estimates the time of flight of the measurement pulsefrom illumination source 160, to a reflective object in the 3-Denvironment, and back to the photodetector 170. A signal 155 indicativeof the estimated time of flight is communicated to master controller 190for further processing and communication to a user of the LIDARmeasurement system 100. In addition, return signal receiver IC 150 isconfigured to digitize segments of the return signal 181 that includepeak values (i.e., return pulses), and communicate signals 156indicative of the digitized segments to master controller 190. In someembodiments, master controller 190 processes these signal segments toidentify properties of the detected object. In some embodiments, mastercontroller 190 communicates signals 156 to a user of the LIDARmeasurement system 100 for further processing.

Master controller 190 is configured to generate a pulse command signal191 that is communicated to receiver IC 150 of integrated LIDARmeasurement device 130. Pulse command signal 191 is a digital signalgenerated by master controller 190. Thus, the timing of pulse commandsignal 191 is determined by a clock associated with master controller190. In some embodiments, the pulse command signal 191 is directly usedto trigger pulse generation by illumination driver IC 152 and dataacquisition by receiver IC 150. However, illumination driver IC 152 andreceiver IC 150 do not share the same clock as master controller 190.For this reason, precise estimation of time of flight becomes much morecomputationally tedious when the pulse command signal 191 is directlyused to trigger pulse generation and data acquisition.

In general, a LIDAR measurement system includes a number of differentintegrated LIDAR measurement devices 130 each emitting a pulsed beam ofillumination light from the LIDAR device into the surroundingenvironment and measuring return light reflected from objects in thesurrounding environment.

In these embodiments, master controller 190 communicates a pulse commandsignal 191 to each different integrated LIDAR measurement device. Inthis manner, master controller 190 coordinates the timing of LIDARmeasurements performed by any number of integrated LIDAR measurementdevices. In a further aspect, beam shaping optical elements 163 and beamscanning device 164 are in the optical path of the illumination pulsesand return measurement pulses associated with each of the integratedLIDAR measurement devices. In this manner, beam scanning device 164directs each illumination pulse and return measurement pulse of LIDARmeasurement system 100.

In the depicted embodiment, receiver IC 150 receives pulse commandsignal 191 and generates a pulse trigger signal, V_(TRG) 151, inresponse to the pulse command signal 191. Pulse trigger signal 151 iscommunicated to illumination driver IC 152 and directly triggersillumination driver IC 152 to electrically couple illumination source160 to power supply 133 and generate a pulse of illumination light 162.In addition, pulse trigger signal 151 directly triggers data acquisitionof return signal 181 and associated time of flight calculation. In thismanner, pulse trigger signal 151 generated based on the internal clockof receiver IC 150 is employed to trigger both pulse generation andreturn pulse data acquisition. This ensures precise synchronization ofpulse generation and return pulse acquisition which enables precise timeof flight calculations by time-to-digital conversion.

FIG. 2 depicts an illustration of the timing associated with theemission of a measurement pulse from an integrated LIDAR measurementdevice 130 and capture of the returning measurement pulse. As depictedin FIG. 2, a measurement is initiated by the rising edge of pulsetrigger signal 162 generated by receiver IC 150. As depicted in FIGS. 1and 2, an amplified, return signal 181 is received by receiver IC 150.As described hereinbefore, a measurement window (i.e., a period of timeover which collected return signal data is associated with a particularmeasurement pulse) is initiated by enabling data acquisition at therising edge of pulse trigger signal 162. Receiver IC 150 controls theduration of the measurement window, T_(measurement), to correspond withthe window of time when a return signal is expected in response to theemission of a measurement pulse sequence. In some examples, themeasurement window is enabled at the rising edge of pulse trigger signal162 and is disabled at a time corresponding to the time of flight oflight over a distance that is approximately twice the range of the LIDARsystem. In this manner, the measurement window is open to collect returnlight from objects adjacent to the LIDAR system (i.e., negligible timeof flight) to objects that are located at the maximum range of the LIDARsystem. In this manner, all other light that cannot possibly contributeto useful return signal is rejected.

As depicted in FIG. 2, return signal 181 includes three returnmeasurement pulses that correspond with the emitted measurement pulse.In general, signal detection is performed on all detected measurementpulses. Further signal analysis may be performed to identify the closestvalid signal 181B (i.e., first valid instance of the return measurementpulse), the strongest signal, and the furthest valid signal 181C (i.e.,last valid instance of the return measurement pulse in the measurementwindow). Any of these instances may be reported as potentially validdistance measurements by the LIDAR system.

Internal system delays associated with emission of light from the LIDARsystem (e.g., signal communication delays and latency associated withthe switching elements, energy storage elements, and pulsed lightemitting device) and delays associated with collecting light andgenerating signals indicative of the collected light (e.g., amplifierlatency, analog-digital conversion delay, etc.) contribute to errors inthe estimation of the time of flight of a measurement pulse of light.Thus, measurement of time of flight based on the elapsed time betweenthe rising edge of the pulse trigger signal 162 and each valid returnpulse (i.e., 181B and 181C) introduces undesireable measurement error.In some embodiments, a calibrated, pre-determined delay time is employedto compensate for the electronic delays to arrive at a correctedestimate of the actual optical time of flight. However, the accuracy ofa static correction to dynamically changing electronic delays islimited. Although, frequent re-calibrations may be employed, this comesat a cost of computational complexity and may interfere with systemup-time.

In another aspect, receiver IC 150 measures time of flight based on thetime elapsed between the detection of a detected pulse 181A due tointernal cross-talk between the illumination source 160 andphotodetector 170 and a valid return pulse (e.g., 181B and 181C). Inthis manner, systematic delays are eliminated from the estimation oftime of flight. Pulse 181A is generated by internal cross-talk witheffectively no distance of light propagation. Thus, the delay in timefrom the rising edge of the pulse trigger signal and the instance ofdetection of pulse 181A captures all of the systematic delays associatedwith illumination and signal detection. By measuring the time of flightof valid return pulses (e.g., return pulses 181B and 181C) withreference to detected pulse 181A, all of the systematic delaysassociated with illumination and signal detection due to internalcross-talk are eliminated. As depicted in FIG. 2, receiver IC 150estimates the time of flight, TOF₁, associated with return pulse 181Band the time of flight, TOF₂, associated with return pulse 181C withreference to return pulse 181A.

In some embodiments, the signal analysis is performed by receiver IC150, entirely. In these embodiments, signals 155 communicated fromintegrated LIDAR measurement device 130 include an indication of thetime of flight determined by receiver IC 150. In some embodiments,signals 156 include digitized segments of return signal 181 generated byreceiver IC 150. These raw measurement signal segments are processedfurther by one or more processors located on board the 3-D LIDAR system,or external to the 3-D LIDAR system to arrive at another estimate ofdistance, an estimate of one of more physical properties of the detectedobject, or a combination thereof.

FIG. 3 depicts a light emission/collection engine 112 in one embodiment.Light emission/collection engine 112 includes an array of integratedLIDAR measurement devices 113. Each integrated LIDAR measurement deviceincludes a light emitting element, a light detecting element, andassociated control and signal conditioning electronics integrated onto acommon substrate (e.g., electrical board).

Light emitted from each integrated LIDAR measurement device passesthrough beam shaping optical elements 116 that collimate the emittedlight to generate a beam of illumination light projected from the 3-DLIDAR system into the environment. In this manner, an array of beams oflight 105, each emitted from a different LIDAR measurement device areemitted from 3-D LIDAR system 100 as depicted in FIG. 3. In general, anynumber of LIDAR measurement devices can be arranged to simultaneouslyemit any number of light beams from 3-D LIDAR system 100. Lightreflected from an object in the environment due to its illumination by aparticular LIDAR measurement device is collected by beam shaping opticalelements 116. The collected light passes through beam shaping opticalelements 116 where it is focused onto the detecting element of the same,particular LIDAR measurement device. In this manner, collected lightassociated with the illumination of different portions of theenvironment by illumination generated by different LIDAR measurementdevices is separately focused onto the detector of each correspondingLIDAR measurement device.

FIG. 4 depicts a view of beam shaping optical elements 116 in greaterdetail. As depicted in FIG. 4, beam shaping optical elements 116 includefour lens elements 116A-D arranged to focus collected light 118 ontoeach detector of the array of integrated LIDAR measurement devices 113.In the embodiment depicted in FIG. 4, light passing through optics 116is reflected from mirror 124 and is directed onto each detector of thearray of integrated LIDAR measurement devices. In some embodiments, oneor more of the beam shaping optical elements 116 is constructed from oneor more materials that absorb light outside of a predeterminedwavelength range. The predetermined wavelength range includes thewavelengths of light emitted by the array of integrated LIDARmeasurement devices 113. In one example, one or more of the lenselements are constructed from a plastic material that includes acolorant additive to absorb light having wavelengths less than infraredlight generated by each of the array of integrated LIDAR measurementdevices 113. In one example, the colorant is Epolight 7276A availablefrom Aako BV (The Netherlands). In general, any number of differentcolorants can be added to any of the plastic lens elements of optics 116to filter out undesired spectra.

FIG. 5 depicts an embodiment 200 of a 3-D LIDAR system employing a beamscanning device. Embodiment 200 includes a one-dimensional array oflight sources 201A-C (i.e., an array of light sources aligned in asingle plane such as the xy plane depicted in FIG. 5). Each light sourceis associated with a different LIDAR measurement channel. Light emittedfrom each light source 201A-C is divergent. These divergent beams passthrough beam shaping optics 202 (e.g., collimating optics) where theemitted light is approximately collimated. The term “approximately”collimated is employed to note that in practice, perfect collimation oflight beams is rarely achieved. Thus, typically, the resulting beamsremain slightly divergent or convergent after passing through beamshaping optics 202. After passing through beam shaping optics 202, eachbeam reflects from the surface of scanning mirror 203. Scanning mirror203 is rotated in an oscillatory manner about axis 205 by actuator 206in accordance with command signals 207 received from a controller (e.g.,master controller 190). As depicted in FIG. 5, the reflected beams204A-C are associated with light sources 201A-C, respectively. Scanningmirror 203 is oriented such that reflected beams 204A-C do not intersectwith collimating optics 202, light sources 201A-C, or any other elementsof the illumination and detection systems of the 3-D LIDAR system.Furthermore, reflected beams 204A-C maintain their separate trajectoriesin the x-direction. In this manner, the objects in the environment areinterrogated by different beams of illumination light at differentlocations in the x-direction. In some embodiments, the reflected beamsfan out over a range of angles that is less than 40 degrees measured inthe x-y plane.

Scanning mirror 203 causes beams 204A-C to sweep in the z-direction (inand out of the drawing depicted in FIG. 5). In some embodiments, thereflected beams scan over a range of angles that is less than 120degrees measured in the y-z plane.

FIG. 6 depicts another embodiment 300 of a 3-D LIDAR system employing abeam scanning device. Embodiment 300 includes a one-dimensional array oflight sources 301A-C, each associated with a different LIDAR measurementchannel. Light sources 301A-C are located in a one-dimensional array(i.e., located on a plane parallel to the z-direction; in and out of thedrawing depicted in FIG. 6). Light emitted from each light source 301A-Cis divergent. These divergent beams pass through beam shaping optics 302where they are approximately collimated. After passing through beamshaping optics 302, each beam reflects from the surface of scanningmirror 303. The reflected beams 304A-C fan out in the y-z plane (i.e.,in and out of the drawing depicted in FIG. 6). Scanning mirror 303rotates in an oscillatory manner (e.g., within a range of angles between+α and −α) about an axis 305 aligned with the surface of scanning mirror303 and oriented in the z-direction as depicted in FIG. 6. Scanningmirror 203 is rotated in an oscillatory manner about axis 305 byactuator 306 in accordance with command signals 307 received from acontroller (e.g., master controller 190). As depicted in FIG. 6, thereflected beams 304A-C are associated with light source 301A-C. Scanningmirror 303 is oriented such that reflected beams 304A-C do not intersectwith collimating optics 302, light sources 301A-C, or any other elementsof the illumination and detection systems of the 3-D LIDAR system.Furthermore, reflected beams 304A-C maintain their separate trajectoriesin the z-direction. In this manner, the objects in the environment areinterrogated by different beams of illumination light at differentlocations in the z-direction. In some embodiments, the reflected beamsfan out over a range of angles that is less than 40 degrees measured inthe y-z plane.

Scanning mirror 303 causes beams 304A-C to sweep in the x-direction. Insome embodiments, the reflected beams scan over a range of angles thatis less than 120 degrees measured in the x-y plane.

In the embodiment depicted in FIG. 5, each light source of the array oflight sources 201A-C is located in a plane. Similarly, in the embodimentdepicted in FIG. 6, each light source of the array of light sources301A-C is located in a plane. This is often referred to as aone-dimensional array of light sources. In the embodiment depicted inFIG. 5, axis 205 of scanning mirror 203 lies in the plane (e.g., the x-yplane) including light sources 201A-C. Similarly, in the embodimentdepicted in FIG. 6, axis 305 of scanning mirror 303 lies in the planeincluding light sources 301A-C. However, in general, the array of lightsources may be 2-D.

FIG. 7 depicts another embodiment 400 of a 3-D LIDAR system. Embodiment400 includes a 2-D array of light sources 401A-D, each associated with adifferent LIDAR measurement channel. Light sources 401A-B are located ina plane (i.e., located on a plane parallel to the z-direction and lightsources 401C-D are located in another plane parallel to the z-direction.In addition, light sources 401A and 401C are located in a plane parallelto the xy plane and light sources 401B and 401D are located in anotherplane parallel to the xy plane. Light emitted from each light source401A-D is divergent. These divergent beams pass through beam shapingoptics 402 where they are approximately collimated. After passingthrough beam shaping optics 402, each beam reflects from the surface ofscanning mirror 403. The reflected beams 404A-B and reflected beams404C-D fan out in the y-z plane (i.e., in and out of the drawingdepicted in FIG. 7). Scanning mirror 403 rotates in an oscillatorymanner (e.g., within a range of angles between +α and −α) about an axis405 aligned with the surface of scanning mirror 403 and oriented in thez-direction as depicted in FIG. 7. Scanning mirror 403 is rotated in anoscillatory manner about axis 405 by actuator 406 in accordance withcommand signals 407 received from a controller (e.g., master controller190). As depicted in FIG. 7, the reflected beams 404A-D are associatedwith light source 401A-D. Scanning mirror 403 is oriented such thatreflected beams 404A-D do not intersect with collimating optics 402,light sources 401A-C, or any other elements of the illumination anddetection systems of the 3-D LIDAR system. Furthermore, reflected beams404A-D maintain their separate trajectories in the z-direction and thex-direction. In this manner, the objects in the environment areinterrogated by different beams of illumination light at differentlocations in the z-direction. In some embodiments, the reflected beamsfan out over a range of angles that is less than 40 degrees measured inthe y-z plane.

Scanning mirror 403 causes beams 404A-D to sweep in the x-direction. Insome embodiments, the reflected beams scan over a range of angles thatis less than 120 degrees measured in the x-y plane. In a further aspect,the range of scanning angles is configured such that a portion of theenvironment interrogated by reflected beams 404A and 404B is alsointerrogated by reflected beams 404C and 404D, respectively. This isdepicted by the angular “overlap” range depicted in FIG. 7. In thismanner, the spatial sampling resolution in this portion of theenvironment is effectively increased because this portion of theenvironment is being sampled by two different beams at different times.

In another further aspect, the scanning angle approximately tracks asinusoidal function. As such, the dwell time near the middle of the scanis significantly less than the dwell time near the end of the scan. Inthis manner, the spatial sampling resolution of the 3-D LIDAR system ishigher at the ends of the scan.

In the embodiment 400 depicted in FIG. 7, four light sources arearranged in a 2×2 array. However, in general, any number of lightsources may be arranged in any suitable manner. In one example, the 2x2array is tilted with respect to the scanning mirror such that themeasurement beams are interlaced in the overlap region.

In another aspect, the light source and detector of each LIDARmeasurement channel is moved in two dimensions relative to the beamshaping optics employed to collimate light emitted from the lightsource. The 2-D motion is aligned with the optical plane of the beamshaping optic and effectively expands the field of view and increasesthe sampling density within the field of view of the 3-D LIDAR system.

FIG. 8 depicts an embodiment 210 of a 3-D LIDAR system employing a 2-Darray of light sources 211, including light sources 212A-C. Lightsources 212A-C are each associated with a different LIDAR measurementchannel. Light emitted from each light source 212A-C is divergent. Thesedivergent beams pass through beam shaping optics 213 where they areapproximately collimated. Collimated beams 214A-C, are each associatedwith light sources 212A-C, respectively. The collimated beams 214A-Cpass on the 3-D environment to be measured. The term “approximately”collimated is employed to note that in practice, perfect collimation oflight beams is rarely achieved. Thus, typically, the resulting beamsremain slightly divergent or convergent after passing through beamshaping optics 213.

In the depicted embodiment, the 2-D array of light sources 211 is movedin one direction (e.g., the X_(S) direction) by actuator 216, and thebeam shaping optics 213 are moved in an orthogonal direction (e.g., theY_(C) direction) by actuator 215. The relative motion in orthogonaldirections between the 2-D array of light sources 211 and the beamshaping optics 213 effectively scans the collimated beams 214A-C overthe 3-D environment to be measured. This effectively expands the fieldof view and increases the sampling density within the field of view ofthe 3-D LIDAR system. The 2-D array of light sources 211 is translatedin an oscillatory manner parallel to the X_(S) by actuator 216 and thebeam shaping optic 213 is translated in an oscillatory manner parallelto the Y_(C) axis in accordance with command signals 217 received from acontroller (e.g., master controller 190).

In the embodiment depicted in FIG. 8, the X_(C)-Y_(C) plane is parallelto the X_(S)-Y_(S) plane. As depicted in FIG. 8, the source and detectorof each LIDAR measurement channel is moved in two dimensions relative tothe beam shaping optics employed to collimate light emitted from thelight source. The motion of both the 2-D array of light sources 211 andthe beam shaping optics 213 is aligned with the optical plane of thecollimating optic (i.e., X_(C)-Y_(C) plane). In general, the same effectmay be achieved by moving the array of light sources 211 in both theX_(S) and Y_(S) directions, while keeping collimating optics 213stationary. Similarly, the same effect may be achieved by moving thebeam shaping optics 213 in both the X_(C) and Y_(C) directions, whilekeeping the array of light sources 211 stationary.

In general, the rotations of scanning mirrors 203, 303, 403, and thedisplacements of the array of light sources 211, beam shaping optics213, may be realized by any suitable drive system. In one example,flexture mechanisms harmonically driven by electrostatic actuators maybe employed to exploit resonant behavior. In another example, aneccentric, rotary mechanism may be employed to transform a rotary motiongenerated by an rotational actuator into a 2-D planar motion. Ingeneral, the motion may be generated by any suitable actuator system(e.g., an electromagnetic actuator, a piezo actuator, etc.). In general,the motion may be sinusoidal, pseudorandom, or track any other suitablefunction.

FIG. 9 depicts an integrated LIDAR measurement device 120 in anotherembodiment. Integrated LIDAR measurement device 120 includes a pulsedlight emitting device 122, a light detecting element 123, associatedcontrol and signal conditioning electronics integrated onto a commonsubstrate 121 (e.g., electrical board), and connector 126. Pulsedemitting device 122 generates pulses of illumination light 124 anddetector 123 detects collected light 125. Integrated LIDAR measurementdevice 120 generates digital signals indicative of the distance betweenthe 3-D LIDAR system and an object in the surrounding environment basedon a time of flight of light emitted from the integrated LIDARmeasurement device 120 and detected by the integrated LIDAR measurementdevice 120. Integrated LIDAR measurement device 120 is electricallycoupled to the 3-D LIDAR system via connector 126. Integrated LIDARmeasurement device 120 receives control signals from the 3-D LIDARsystem and communicates measurement results to the 3-D LIDAR system overconnector 126.

FIG. 10 depicts a schematic view of an integrated LIDAR measurementdevice 130 in another embodiment. Integrated LIDAR measurement device130 includes a pulsed light emitting device 134, a light detectingelement 138, a beam splitter 135 (e.g., polarizing beam splitter,regular beam splitter, etc.), an illumination driver 133, signalconditioning electronics 139, analog to digital (A/D) conversionelectronics 140, controller 132, and digital input/output (I/O)electronics 131 integrated onto a common substrate 144.

As depicted in FIG. 10, a measurement begins with a pulse firing signal146 generated by controller 132. In some examples, a pulse index signalis determined by controller 132 that is shifted from the pulse firingsignal 146 by a time delay, T_(D). The time delay includes the knowndelays associated with emitting light from the LIDAR system (e.g.,signal communication delays and latency associated with the switchingelements, energy storage elements, and pulsed light emitting device) andknown delays associated with collecting light and generating signalsindicative of the collected light (e.g., amplifier latency,analog-digital conversion delay, etc.).

Illumination driver 133 generates a pulse electrical current signal 145in response to pulse firing signal 146. Pulsed light emitting device 134generates pulsed light emission 136 in response to pulsed electricalcurrent signal 145. The illumination light 136 is focused and projectedonto a particular location in the surrounding environment by one or moreoptical elements of the LIDAR system (not shown).

In some embodiments, the pulsed light emitting device is laser based(e.g., laser diode). In some embodiments, the pulsed illuminationsources are based on one or more light emitting diodes. In general, anysuitable pulsed illumination source may be contemplated.

As depicted in FIG. 10, return light 137 reflected from the surroundingenvironment is detected by light detector 138. In some embodiments,light detector 138 is an avalanche photodiode. Light detector 138generates an output signal 147 that is amplified by signal conditioningelectronics 139. In some embodiments, signal conditioning electronics139 includes an analog trans-impedance amplifier. However, in general,the amplification of output signal 147 may include multiple, amplifierstages. In this sense, an analog trans-impedance amplifier is providedby way of non-limiting example, as many other analog signalamplification schemes may be contemplated within the scope of thispatent document.

The amplified signal is communicated to A/D converter 140. The digitalsignals are communicated to controller 132. Controller 132 generates anenable/disable signal employed to control the timing of data acquisitionby ADC 140 in concert with pulse firing signal 146.

As depicted in FIG. 10, the illumination light 136 emitted fromintegrated LIDAR measurement device 130 and the return light 137directed toward integrated LIDAR measurement device share a common path.In the embodiment depicted in FIG. 10, the return light 137 is separatedfrom the illumination light 136 by a polarizing beam splitter (PBS) 135.PBS 135 could also be a non-polarizing beam splitter, but this generallywould result in an additional loss of light. In this embodiment, thelight emitted from pulsed light emitting device 134 is polarized suchthat the illumination light passes through PBS 135. However, returnlight 137 generally includes a mix of polarizations. Thus, PBS 135directs a portion of the return light toward detector 138 and a portionof the return light toward pulsed light emitting device 134. In someembodiments, it is desirable to include a quarter waveplate after PBS135. This is advantageous in situations when the polarization of thereturn light is not significantly changed by its interaction with theenvironment. Without the quarter waveplate, the majority of the returnlight would pass through PBS 135 and be directed toward the pulsed lightemitting device 134, which is undesireable. However, with the quarterwaveplate, the majority of the return light will pass through PBS 135and be directed toward detector 138.

In general, a multiple pixel 3-D LIDAR system includes a plurality ofLIDAR measurement channels. In some embodiments, a multiple pixel 3-DLIDAR system includes a plurality of integrated LIDAR measurementdevices each emitting a pulsed beam of illumination light from the LIDARdevice into the surrounding environment and measuring return lightreflected from objects in the surrounding environment.

In some embodiments, digital I/O 131, timing logic 132, A/D conversionelectronics 140, and signal conditioning electronics 139 are integratedonto a single, silicon-based microelectronic chip. In another embodimentthese same elements are integrated into a single gallium-nitride orsilicon based circuit that also includes the illumination driver. Insome embodiments, the A/D conversion electronics and controller 132 arecombined as a time-to-digital converter.

In some embodiments, the time of flight signal analysis is performed bycontroller 132, entirely. In these embodiments, signals 143 communicatedfrom integrated LIDAR measurement device 130 include an indication ofthe distances determined by controller 132. In some embodiments, signals143 include the digital signals 148 generated by A/D converter 140.These raw measurement signals are processed further by one or moreprocessors located on board the 3-D LIDAR system, or external to the 3-DLIDAR system to arrive at a measurement of distance. In someembodiments, controller 132 performs preliminary signal processing stepson signals 148 and signals 143 include processed data that is furtherprocessed by one or more processors located on board the 3-D LIDARsystem, or external to the 3-D LIDAR system to arrive at a measurementof distance.

In some embodiments a 3-D LIDAR system includes multiple integratedLIDAR measurement devices. In some embodiments, a delay time is setbetween the firing of each integrated LIDAR measurement device. Signal142 includes an indication of the delay time associated with the firingof integrated LIDAR measurement device 130. In some examples, the delaytime is greater than the time of flight of the measurement pulsesequence to and from an object located at the maximum range of the LIDARdevice. In this manner, there is no cross-talk among any of theintegrated LIDAR measurement devices. In some other examples, ameasurement pulse is emitted from one integrated LIDAR measurementdevice before a measurement pulse emitted from another integrated LIDARmeasurement device has had time to return to the LIDAR device. In theseembodiments, care is taken to ensure that there is sufficient spatialseparation between the areas of the surrounding environment interrogatedby each beam to avoid cross-talk.

FIG. 11 illustrates a flowchart of a method 500 suitable forimplementation by a LIDAR system as described herein. In someembodiments, LIDAR system 100 is operable in accordance with method 500illustrated in FIG. 11. However, in general, the execution of method 500is not limited to the embodiments of LIDAR system 100 described withreference to FIG. 1. These illustrations and corresponding explanationare provided by way of example as many other embodiments and operationalexamples may be contemplated.

In block 501, a plurality of pulses of illumination light are emittedinto a 3-D environment from a plurality of pulsed illumination sources.Each of the plurality of pulses of illumination light are incident on abeam scanning device.

In block 502, each of the plurality of pulses is redirected in adifferent direction based on an optical interaction between each pulseof illumination light and the beam scanning device.

In block 503, an amount of return light reflected from the 3-Denvironment illuminated by each pulse of illumination light isredirected based on an optical interaction between each amount of returnlight and the beam scanning device.

In block 504, each amount of return light reflected from the 3-Denvironment illuminated by each pulse of illumination light is detected(e.g., by a photosensitive detector).

In block 505, an output signal indicative of the detected amount ofreturn light associated with each pulse of illumination light isgenerated.

In block 506, a distance between the plurality of pulsed illuminationsources and an object in the 3-D environment is determined based on adifference between a time when each pulse is emitted from the LIDARdevice and a time when each photosensitive detector detects an amount oflight reflected from the object illuminated by the pulse of illuminationlight.

Master controller 190 or any external computing system may include, butis not limited to, a personal computer system, mainframe computersystem, workstation, image computer, parallel processor, or any otherdevice known in the art. In general, the term “computing system” may bebroadly defined to encompass any device having one or more processors,which execute instructions from a memory medium.

Program instructions 192 implementing methods such as those describedherein may be transmitted over a transmission medium such as a wire,cable, or wireless transmission link. For example, as illustrated inFIG. 1, program instructions 192 stored in memory 191 are transmitted toprocessor 195 over bus 194. Program instructions 192 are stored in acomputer readable medium (e.g., memory 191). Exemplary computer-readablemedia include read-only memory, a random access memory, a magnetic oroptical disk, or a magnetic tape.

In one or more exemplary embodiments, the functions described may beimplemented in hardware, software, firmware, or any combination thereof.If implemented in software, the functions may be stored on ortransmitted over as one or more instructions or code on acomputer-readable medium. Computer-readable media includes both computerstorage media and communication media including any medium thatfacilitates transfer of a computer program from one place to another. Astorage media may be any available media that can be accessed by ageneral purpose or special purpose computer. By way of example, and notlimitation, such computer-readable media can comprise RAM, ROM, EEPROM,CD-ROM or other optical disk storage, magnetic disk storage or othermagnetic storage devices, or any other medium that can be used to carryor store desired program code means in the form of instructions or datastructures and that can be accessed by a general-purpose orspecial-purpose computer, or a general-purpose or special-purposeprocessor. Also, any connection is properly termed a computer-readablemedium. For example, if the software is transmitted from a website,server, or other remote source using a coaxial cable, fiber optic cable,twisted pair, digital subscriber line (DSL), or wireless technologiessuch as infrared, radio, and microwave, then the coaxial cable, fiberoptic cable, twisted pair, DSL, or wireless technologies such asinfrared, radio, and microwave are included in the definition of medium.Disk and disc, as used herein, includes compact disc (CD), laser disc,optical disc, digital versatile disc (DVD), floppy disk and blu-ray discwhere disks usually reproduce data magnetically, while discs reproducedata optically with lasers. Combinations of the above should also beincluded within the scope of computer-readable media.

Although certain specific embodiments are described above forinstructional purposes, the teachings of this patent document havegeneral applicability and are not limited to the specific embodimentsdescribed above. Accordingly, various modifications, adaptations, andcombinations of various features of the described embodiments can bepracticed without departing from the scope of the invention as set forthin the claims.

What is claimed is:
 1. A light detection and ranging (LIDAR) devicecomprising: a plurality of illumination sources, each of the pluralityof illumination sources configured to emit illumination light from theLIDAR device into a three-dimensional (3-D) environment; a plurality ofphotosensitive detectors, each of the plurality of photosensitivedetectors configured to detect an amount of return light reflected fromthe 3-D environment when illuminated by the illumination light; and abeam scanning device disposed in an optical path of the plurality ofillumination sources, the beam scanning device configured to redirectthe illumination light with respect to each of the plurality ofillumination sources.
 2. The LIDAR device of claim 1, wherein theplurality of illumination sources and the plurality of photosensitivedetectors are stationary and wherein the beam scanning device includesan optical element that is actuated relative to the plurality ofillumination sources and the plurality of photosensitive detectors. 3.The LIDAR device of claim 1, further comprising: a beam shaping opticalelement disposed in the optical path between the plurality ofillumination sources and the beam scanning device.
 4. The LIDAR deviceof claim 1, wherein a first range of the 3-D environment scanned byillumination light from a first illumination source of the plurality ofillumination sources spatially overlaps a second range of the 3-Denvironment scanned by illumination light from a second illuminationsource of the plurality of illumination sources.
 5. The LIDAR device ofclaim 1, wherein the beam scanning device includes a mirror element andan actuator configured to rotate the mirror element about an axis ofrotation.
 6. The LIDAR device of claim 5, wherein the mirror element isrotated about the axis of rotation with an oscillatory angular velocity.7. The LIDAR device of claim 5, wherein the plurality of illuminationsources are disposed in a plane substantially parallel to the axis ofrotation.
 8. The LIDAR device of claim 5, wherein the plurality ofillumination sources are disposed in a plane substantially perpendicularto the axis of rotation.
 9. The LIDAR device of claim 1, wherein thebeam scanning device includes a beam shaping optical element.
 10. TheLIDAR device of claim 9, wherein the beam scanning device furtherincludes a first actuator configured to translate the beam shapingoptical element in a first direction substantially parallel to anoptical plane of the beam shaping optical element.
 11. The LIDAR deviceof claim 10, further comprising: a second actuator configured totranslate the plurality of illumination sources in a second directionsubstantially parallel to the optical plane of the beam shaping opticalelement, wherein the first and second directions are differentdirections.
 12. The LIDAR device of claim 11, wherein the firstdirection is substantially perpendicular to the second direction. 13.The LIDAR device of claim 1, wherein the plurality of illuminationsources are arranged as a two-dimensional array of illumination sources.14. The LIDAR device of claim 1, wherein the beam scanning device isconfigured to redirect light from one or more of the plurality ofillumination sources in response to a command signal generated by thecomputing system.
 15. The LIDAR device of claim 1, further comprising: acomputing system configured to determine a distance between the LIDARdevice and an object in the 3-D environment based on the amount ofreturn light detected by one or more of the plurality of photosensitivedetectors.
 16. The LIDAR device of claim 15, wherein the computingsystem is configured to determine the distance between the LIDAR deviceand an object in the 3-D environment by measuring a difference between afirst time when illumination light is emitted from one or more of theplurality of illumination sources and second time when return light isdetected by one or more of the plurality of photosensitive detectors.17. The LIDAR device of claim 1, further comprising: a non-transientcomputer-readable medium including instructions, which when executed bya computing system, cause the computing system to determine a distancebetween the LIDAR device and an object in the 3-D environment based onthe amount of return light detected by one or more of the plurality ofphotosensitive detectors.
 18. A method comprising: emitting illuminationlight from a plurality of illumination sources into a three-dimensional(3-D) environment; redirecting the illumination light from each of theplurality of illumination sources using a beam scanning device disposedin an optical path of the plurality of illumination sources; detectingan amount of return light reflected from the 3-D environment illuminatedby the illumination light; and generating an output indicative of thedetected amount of return light.
 19. The method of claim 18, furthercomprising: processing the output to determine a distance between theplurality of illumination sources and an object in the 3-D environment.20. The method of claim 19, wherein processing the output to determinethe distance between the plurality of illumination sources and theobject in the 3-D environment includes: measuring a difference between afirst time when illumination light is emitted and second time whenreturn light is detected.
 21. The method of claim 18, furthercomprising: redirecting the return light using the beam scanning devicebefore detecting the amount of return light.
 22. The method of claim 18,wherein redirecting the illumination light includes: causing an actuatorto move an optical element relative to the plurality of illuminationsources.
 23. The method of claim 22, wherein the optical element is amirror and wherein causing the actuator to move the mirror includescausing the actuator to rotate the mirror about a rotation axis.
 24. Themethod of claim 23, wherein the optical element is a beam shapingoptical element and wherein the causing the actuator to move the beamshaping optical element includes causing the actuator to translate thebeam shaping optical element in a direction substantially parallel to anoptical plane of the beam shaping optical element.
 25. A computer systemcomprising: a processor; and a memory communicatively coupled to theprocessor, the memory having instructions stored thereon, which whenexecuted by the processor, cause the computer system to: generate afirst signal configured to cause a plurality of illumination sources toemit illumination light into a three-dimensional (3-D) environment;generate a second signal configured to cause an actuator to move anoptical element to redirect the illumination light from each of theplurality of illumination sources, the optical element in an opticalpath of the plurality of illumination sources; receive a third signalindicative of a detected amount of return light reflected from the 3-Denvironment illuminated by the illumination light; and generate anoutput based on the detected amount of return light.
 26. The computersystem of claim 25, wherein the memory has further instructions storedthereon, which when executed by the processor, cause the computer systemto further: generate a fourth signal configured to cause the actuator tomove the optical element to redirect the return light to a plurality ofphotosensitive detectors, the plurality of photosensitive detectorsconfigured to detect the amount of return light in response to the thirdsignal.
 27. The computer system of claim 25, wherein the optical elementis a mirror and wherein causing the actuator to move the mirror includescausing the actuator to rotate the mirror about a rotation axis.
 28. Thecomputer system of claim 25, wherein the optical element is a beamshaping optical element and wherein the causing the actuator to move thebeam shaping optical element includes causing the actuator to translatethe beam shaping optical element in a direction substantially parallelto an optical plane of the beam shaping optical element.
 29. Thecomputer system of claim 25, wherein output is indicative of a distancebetween the plurality of illumination sources and an object in the 3-Denvironment.
 30. The computer system of claim 25, wherein the memory hasfurther instructions stored thereon, which when executed by theprocessor, cause the computer system to further: measure a differencebetween a first time when the first signal was generated and a secondtime when the third signal was received; and determine a distancebetween the plurality of illumination sources and an object in the 3-Denvironment based on the measured difference; wherein the output isindicative of the distance.
 31. The computer system of claim 25, whereinthe memory has further instructions stored thereon, which when executedby the processor, cause the computer system to further: before receivingthe third signal, receive a fourth signal indicative of a detectedamount of light due to internal cross talk when the plurality ofillumination sources emit the illumination light; measure a differencebetween a first time when the fourth signal is received and a secondtime when the third signal is received; and determine a distance betweenthe plurality of illumination sources and an object in the 3-Denvironment based on the measured difference;